Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2117

Supervisor V2 with local mode extracts resources directory to topology root directory instead of temporary directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.0.0, 1.1.0
    • storm-core
    • None

    Description

      20:43:57.692 [timer] INFO  o.a.s.d.nimbus - Setting new assignment for topology id storm-sql-1-1474544636: #org.apache.storm.daemon.common.Assignment{:master-code-dir "/var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T//ba7ef925-0dd5-4ddd-91ad-02ff877b99ef", :node->host {"35e30049-e731-40e7-a093-2ac22d9efa34" "192.168.0.9"}, :executor->node+port {[4 4] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [3 3] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [6 6] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [2 2] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [5 5] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [1 1] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024]}, :executor->start-time-secs {[1 1] 1474544637, [2 2] 1474544637, [3 3] 1474544637, [4 4] 1474544637, [5 5] 1474544637, [6 6] 1474544637}, :worker->resources {["35e30049-e731-40e7-a093-2ac22d9efa34" 1024] [0.0 0.0 0.0]}}
      20:43:57.824 [Async Localizer] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
      20:43:57.825 [SLOT_1024] INFO  o.a.s.d.s.Slot - STATE EMPTY msInState: 1016 -> WAITING_FOR_BASIC_LOCALIZATION msInState: 0
      20:43:57.827 [Async Localizer] INFO  o.a.s.b.FileBlobStoreImpl - Creating new blob store based in /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/ba7ef925-0dd5-4ddd-91ad-02ff877b99ef/blobs
      20:43:57.830 [Async Localizer-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
      20:43:57.846 [Curator-Framework-0] INFO  o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
      20:43:57.920 [Async Localizer] INFO  o.a.s.l.AsyncLocalizer - Extracting resources from jar at /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/lib/ant-javafx.jar to /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274/resources
      20:43:57.941 [Async Localizer] WARN  o.a.s.l.AsyncLocalizer - Failed to download basic resources for topology-id storm-sql-1-1474544636
      20:43:57.941 [Async Localizer] INFO  o.a.s.d.s.AdvancedFSOps - Deleting path /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274
      20:43:57.944 [Async Localizer] INFO  o.a.s.d.s.AdvancedFSOps - Deleting path /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636
      20:43:57.947 [Async Localizer] WARN  o.a.s.l.AsyncLocalizer - Caught Exception While Downloading (rethrowing)... 
      java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
      	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_66]
      	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_66]
      	at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396) ~[?:1.8.0_66]
      	at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) ~[?:1.8.0_66]
      	at java.nio.file.Files.move(Files.java:1395) ~[?:1.8.0_66]
      	at org.apache.storm.daemon.supervisor.AdvancedFSOps.moveDirectoryPreferAtomic(AdvancedFSOps.java:159) ~[classes/:?]
      	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:144) [classes/:?]
      	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:98) [classes/:?]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_66]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_66]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_66]
      	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66]
      20:43:57.953 [SLOT_1024] ERROR o.a.s.d.s.Slot - Error when processing event
      java.util.concurrent.ExecutionException: java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_66]
      	at java.util.concurrent.FutureTask.get(FutureTask.java:206) ~[?:1.8.0_66]
      	at org.apache.storm.localizer.LocalDownloadedResource$NoCancelFuture.get(LocalDownloadedResource.java:63) ~[classes/:?]
      	at org.apache.storm.daemon.supervisor.Slot.handleWaitingForBasicLocalization(Slot.java:413) ~[classes/:?]
      	at org.apache.storm.daemon.supervisor.Slot.stateMachineStep(Slot.java:273) ~[classes/:?]
      	at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:741) [classes/:?]
      Caused by: java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
      	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_66]
      	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_66]
      	at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396) ~[?:1.8.0_66]
      	at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) ~[?:1.8.0_66]
      	at java.nio.file.Files.move(Files.java:1395) ~[?:1.8.0_66]
      	at org.apache.storm.daemon.supervisor.AdvancedFSOps.moveDirectoryPreferAtomic(AdvancedFSOps.java:159) ~[classes/:?]
      	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:144) ~[classes/:?]
      	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:98) ~[classes/:?]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_66]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_66]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_66]
      	at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_66]
      20:43:57.954 [SLOT_1024] ERROR o.a.s.u.Utils - Halting process: Error when processing an event
      java.lang.RuntimeException: Halting process: Error when processing an event
      	at org.apache.storm.utils.Utils.exitProcess(Utils.java:1771) [classes/:?]
      	at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:774) [classes/:?]
      
      Process finished with exit code 20
      

      Attachments

        Issue Links

          Activity

            People

              kabhwan Jungtaek Lim
              kabhwan Jungtaek Lim
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h